IMAGE PROCESSING APPARATUS 

Field of Technology 

The present invention relates to an image processing technique 
5 that uses shooting infornnation or information on specification of image 
processing to implement the image processing of image data. 

Background of the Invention 

Digital still cameras (DSC) having shooting modes corresponding 

10 to various shooting scenes, such as portrait and nightscape have been 
widely used. In response to selection of a shooting mode, the DSC is 
set to have preset values of multiple shooting parameters, such as 
shutter speed and exposure, corresponding to the selected shooting 
mode. The photographer is thus not required to individually set the 

15 shooting parameters and easily takes photographs of a subject under 
shooting conditions specified by the selected shooting mode. In the 
case of image data complying with a DSC file format standard Exif 2.2, 
the selected shooting mode is written, together with other shooting 
conditions including a shutter speed, an exposure mode, and a light 

20 source, in a header or an equivalent portion of the image data. 

The applicant of the invention has proposed a practical technique 
that sets image processing control information for specifying image 
processing conditions adopted in an image processing apparatus 
according to the shooting mode selected in the DSC, the shooting 

25 conditions, and the reproduction characteristics of an output device, and 
outputs the settings of the image processing control information related 
to image data. This technique ensures image processing suitable for 
the shooting mode selected by the photographer (that is, image 
processing reflecting the intention of the photographer). The image 

30 processing control information used in this technique is set by taking 
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into account the reproduction characteristics of the output device and is 
thus substantially different from the shooting Information, which simply 
describes the shooting conditions. 

The shooting Information including the shooting mode is, 
5 however. Included In a greater number of image data (Image files), 
compared with the Image processing control information. When the 
image processing control information is not available, it Is desirable to 
utilize the shooting information and thereby make a greater number of 
image data subjected to image processing suitable for a shooting scene 
10 at the time of shooting (that Is, a shooting mode selected by the 
photographer). 

SUMMARY OF THE INVENTION 
In order to solve the above problems of the prior art technique, 

15 the present invention aims to make a greater number of image data 

subjected to a series of image processing suitable for a shooting scene 
at a time of shooting each of the Image data. 

A first application of the invention to attain the above object Is 
directed to an image processing method that makes image data, which 

20 Includes shooting information obtained at a time of shooting, subjected 
to a series of image processing suitable for a selected shooting scene. 
The image processing method in the first application of the invention 
acquires image data; retrieves scene-dependent image processing 
condition specification Information, which Is related to the acquired 

25 image data and Is used to specify a scene-dependent Image processing 
condition suitable for the selected shooting scene; specifies the 
selected shooting scene based on the shooting information, in the case 
of failed retrieval of the scene-dependent Image processing condition 
specification information; acquires a scene-dependent image 

30 processing condition suitable for the specified shooting scene from a 
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memory device, which stores multiple scene-dependent image 
processing conditions set for multiple shooting scenes; and executes 
image quality adjustment of the Image data with the acquired 
scene-dependent image processing condition. 
5 In accordance with the first application of the invention, even 

when the scene-dependent image processing condition specification 
information, which is used to specify the scene-dependent Image 
processing condition suitable for the selected shooting scene, is not 
available, the image processing method in the first application of the 

10 invention utilizes the general shooting information given as attribute 
information of the image data to obtain the scene-dependent image 
processing condition suitable for the selected shooting scene and 
executes image quality adjustment with the obtained scene-dependent 
image processing condition. This arrangement desirably enables a 

15 greater number of image data to be subjected to the image processing 
suitable for the shooting scene at the time of shooting each of the image 
data. 

In the first application of the invention, in the case of successful 
retrieval of the scene-dependent image processing condition 

20 specification information, the image processing method may acquire the 
scene-dependent image processing condition corresponding to the 
retrieved scene-dependent image processing condition specification 
information from the memory device. In this arrangement, the 
scene-dependent image processing condition may be is acquired, based 

25 on the scene-dependent image processing condition specification 
information representing the photographer's intention at the time of 
shooting, thus ensuring execution of image quality adjustment reflecting 
the intention of the photographer. 

In another preferable arrangement of the first application of the 

30 invention, when the shooting information includes preset information of 
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shooting scene, the image processing method may specify the shooting 
scene, based on the preset information of shooting scene. In this 
arrangement, the preset information of shooting scene at the time of 
shooting Is utilized to acquire the scene-dependent Image processing 
5 condition, which reflects the shooting scene, and thereby ensures 
execution of Image quality adjustment suitable for the shooting scene. 

In the image processing method according to the first application 
of the invention, one preferable procedure specifies the shooting scene, 
based on information on settings of exposure program, aperture, shutter 

10 speed, subject distance range, ISO speed rate, and flash Included in the 
shooting Information. These pieces of the shooting Information may be 
used for estimation of the shooting scene. 

In the image processing method according to the first application 
of the invention, when the shooting information does not include the 

15 preset information of shooting scene, the shooting scene may be 
specified, based on information on settings of exposure program, 
aperture, shutter speed, subject distance range, ISO speed rate, and 
flash Included In the shooting Information. This arrangement ensures 
execution of Image quality adjustment suitable for the shooting scene, 

20 even when the information of shooting scene is not available. 

In the image processing method according to the first application 
of the invention, the scene-dependent image processing condition may 
be a combination of values of multiple image quality-relating parameters, 
which are set in advance for each shooting scene. This arrangement 

25 ensures adaptation of image quality adjustment for the shooting scene 
with a high accuracy. 

The first application of the invention Is also actualized by an 
Image processing apparatus that makes image data, which includes 
shooting information obtained at a time of shooting, subjected to a 

30 series of image processing suitable for a selected shooting scene. The 
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image processing apparatus in the first application of the invention 
includes: an image data acquisition unit that acquires image data; a 
memory unit that stores multiple scene-dependent image processing 
conditions set for multiple shooting scenes; a scene-dependent image 
5 processing condition acquisition unit that, in the case of failed retrieval 
of scene-dependent image processing condition specification 
information, which is related to the acquired image data and is used to 
specify a scene-dependent image processing condition suitable for the 
selected shooting scene, specifies the selected shooting scene based 

10 on the shooting information and acquires a scene-dependent image 
processing condition suitable for the specified shooting scene from the 
memory unit; and an image quality adjustment unit that executes image 
quality adjustment of the image data with the acquired scene-dependent 
image processing condition. 

15 The image processing apparatus according to the first 

application of the invention has similar functions and effects to those of 
the image processing method in the first application of the invention and 
has various arrangements as discussed above with regard to the image 
processing method. 

20 The first application of the invention is further actualized by a 

computer program product storing a program that causes a computer to 
utilize multiple scene-dependent image processing conditions set for 
multiple shooting scenes and to make image data, which includes 
shooting information obtained at a time of shooting, subjected to a 

25 series of image processing suitable for a selected shooting scene. In 
the computer program product according to the first application of the 
invention, the program includes: a computer command that retrieves 
scene-dependent image processing condition specification information, 
which is related to acquired image data and is used to specify a 

30 scene-dependent image processing condition suitable for the selected 
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shooting scene; a computer command that specifies the selected 
shooting scene based on the shooting information, in the case of failed 
retrieval of the scene-dependent image processing condition 
specification information; a computer command that selects a 
5 scene-dependent image processing condition suitable for the specified 
shooting scene among the multiple scene-dependent image processing 
conditions; and a computer command that executes image quality 
adjustment of the image data with the selected scene-dependent image 
processing condition. 

10 The computer program product according to the first application 

of the invention has similar functions and effects to those of the image 
processing method in the first application of the invention and has 
various arrangements as discussed above with regard to the image 
processing method. 

15 A second application of the invention is directed to an image 

processing method that executes a series of image processing suitable 
for a shooting scene selected at a time of shooting. The image 
processing method in the second application of the invention acquires 
image data; retrieves image processing control information, which 

20 specifies a scene-dependent image processing condition suitable for the 
selected shooting scene and is related to the acquired image data; in 
the case of successful retrieval of the image processing control 
information, acquired the scene-dependent image processing condition 
specified by the retrieved image processing control information from a 

25 memory device, which stores multiple scene-dependent image 

processing conditions as combinations of values of multiple image 
quality-relating parameters set in advance for multiple shooting scenes; 
and executes image quality adjustment of the image data with the 
acquired scene-dependent image processing condition. 

30 The image processing method in the second application of the 
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invention utilizes the image processing control information, which is 
used to specify the scene-dependent image processing condition 
suitable for the selected shooting scene, to acquire the 
scene-dependent image processing condition suitable for the shooting 
5 scene and executes image quality adjustment with the obtained 
scene-dependent image processing condition. This arrangement 
desirably enables the scene-dependent image processing condition, 
which represents the photographer's intention at the time of shooting, to 
be obtained adequately, thus ensuring execution of image quality 

10 adjustment reflecting the intention of the photographer. 

In one preferable arrangement of the second application of the 
invention, the image processing method determines the shooting scene 
selected at the time of shooting, based on the shooting information. In 
the case of failed retrieval of the image processing control information, 

15 the image processing method acquires out the scene-dependent image 
processing condition suitable for the definitely set shooting scene from 
the memory device. In such cases, the procedure of this arrangement 
utilizes the general shooting information given as attribute information 
of the image data to acquire the scene-dependent image processing 

20 condition suitable for the shooting scene. This desirably enables a 
greater number of image data to be subjected to image quality 
adjustment suitable for the shooting scene at the time of shooting each 
of the image data. 

The second application of the invention is also actualized by an 

25 image processing apparatus that executes a series of image processing 
suitable for a shooting scene selected at a time of shooting. The image 
processing apparatus in the second application of the invention 
includes: an image data acquisition unit that acquires image data; a 
memory unit that stores multiple scene-dependent image processing 

30 conditions as combinations of values of multiple image quality-relating 
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parameters set in advance for multiple shooting scenes; a 
scene-dependent image processing condition acquisition unit that, in 
the case of successful retrieval of image processing control information, 
which specifies a scene-dependent image processing condition suitable 
5 for the selected shooting scene and is related to the acquired image 
data, acquires the scene-dependent image processing condition 
specified by the retrieved image processing control information from the 
memory unit; and an image quality adjustment unit that executes image 
quality adjustment of the image data with the acquired scene-dependent 

10 image processing condition. 

The image processing apparatus according to the second 
application of the invention has similar functions and effects to those of 
the image processing method in the second application of the invention 
and has various arrangements as discussed above with regard to the 

15 image processing method. 

The second application of the invention is further actualized by a 
computer program product storing an image processing program that 
causes a computer to utilize multiple scene-dependent image 
processing conditions as combinations of values of multiple image 

20 quality-relating parameters set in advance for multiple shooting scenes 
and to execute a series of image processing suitable for a shooting 
scene selected at a time of shooting. In the computer program product 
according to the second application of the invention, the image 
processing program includes: a program command that retrieves image 

25 processing control information, which specifies a scene-dependent 

image processing condition suitable for the selected shooting scene and 
is related to acquired image data; a program command that, in the case 
of successful retrieval of the image processing control information, 
selects the scene-dependent image processing condition specified by 

30 the retrieved image processing control information, among the multiple 
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scene-dependent innage processing conditions; and a program 
command that executes image quality adjustment of the image data with 
the selected scene-dependent image processing condition. 

The computer program product according to the second 
5 application of the invention has similar functions and effects to those of 
the image processing method in the second application of the invention 
and has various arrangements as discussed above with regard to the 
image processing method. 

A third application of the invention is directed to an image 

10 processing method that makes image data, which includes shooting 
Information obtained at a time of shooting, subjected to a series of 
image processing. The image processing method in the third 
application of the invention retrieves image processing control 
information, which is related to the image data and is used to specify an 

15 image processing condition; in the case of failed retrieval of the image 
processing control information, selects an image processing condition, 
which is suitable for a shooting condition at the time of shooting, based 
on the shooting Information from a memory device that stores multiple 
different image processing conditions set for the image data; and 

20 executes image quality adjustment of the image data with the selected 
image processing condition. 

In accordance with the third application of the invention, even 
when the image processing control information, which is used to specify 
the image processing condition, is not available, the image processing 

25 method in the third application of the invention utilizes the general 

shooting information given as attribute information of the image data to 
acquire the image processing condition, which corresponds to the image 
data and is suitable for the shooting condition at the time of shooting, 
and executes image quality adjustment with the obtained image 

30 processing condition. This arrangement desirably enables a greater 
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number of image data to be subjected to the image processing suitable 
for the shooting condition at the time of shooting each of the image data. 

In one preferable arrangement of the third application of the 
invention, in the case of successful retrieval of the image processing 
5 control Information, the image processing method selects an image 
processing condition specified by the retrieved image processing control 
information from the memory device. The procedure of this 
arrangement utilizes the image processing control information to 
acquire the image processing condition, thus ensuring execution of 

10 image quality adjustment reflecting the intention of the photographer. 

In another preferable arrangement of the third application of the 
invention, when the shooting Information includes preset information of 
shooting scene at the time of shooting, the Image processing method 
selects the image processing condition, based on the preset information 

15 of shooting scene. The procedure of this arrangement utilizes the 

preset information of shooting scene at the time of shooting to acquire 
the image processing condition, which reflects the shooting scene, and 
thereby ensures execution of image quality adjustment suitable for the 
shooting scene. 

20 In still another preferable arrangement of the third application of 

the invention, the image processing method selects the image 
processing condition, based on at least information on settings of 
exposure program, aperture, shutter speed, subject distance range, ISO 
speed rate, and flash included in the shooting Information. These 

25 pieces of the shooting information may be used for estimation of the 
shooting scene. 

When the shooting Information does not Include the preset 
information of shooting scene at the time of shooting, the Image 
processing condition may be selected, based on at least information on 

30 settings of exposure program, aperture, shutter speed, subject distance 
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range, ISO speed rate, and flash included in the shooting information. 
This arrangennent ensures execution of image quality adjustment 
suitable for the shooting scene, even when the information of shooting 
scene is not available. 
5 In the image processing method according to the third 

application of the invention, the image processing condition may be a 
combination of values of multiple image quality-relating parameters, 
which are set in advance for each shooting scene. This arrangement 
ensures adaptation of image quality adjustment for the shooting scene 

10 with a high accuracy. 

The third application of the Invention is also actualized by an 
image processing apparatus that makes Image data, which includes 
shooting information obtained at a time of shooting, subjected to a 
series of image processing. The image processing apparatus in the 

15 third application of the invention includes: a memory unit that stores 
multiple different image processing conditions set for the image data; a 
selection unit that, in the case of failed retrieval of image processing 
control information that is related to the Image data and is used to 
specify an image processing condition, selects an image processing 

20 condition, which is suitable for a shooting condition at the time of 

shooting, based on the shooting information from the memory unit; and 
an image quality adjustment unit that executes image quality adjustment 
of the image data with the selected image processing condition. 
The image processing apparatus according to the third 

25 application of the invention has similar functions and effects to those of 
the image processing method in the third application of the invention 
and has various arrangements as discussed above with regard to the 
image processing method. 

The third application of the invention is further actualized by a 

30 computer program product storing an image processing program that 
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causes a computer to make image data, which includes shooting 
information obtained at a time of shooting, subjected to a series of 
image processing. In the computer program product according to the 
third application of the invention, the image processing program 
5 includes: a program command that retrieves image processing control 
information that is related to the image data and is used to specify an 
image processing condition; a program command that, in the case of 
failed retrieval of the image processing control information, selects an 
image processing condition, which is suitable for a shooting condition at 

10 the time of shooting, based on the shooting information among multiple 
different image processing conditions set in advance for the image data; 
and a program command that executes image quality adjustment of the 
image data with the selected image processing condition. 

The computer program product according to the third application 

15 of the invention has similar functions and effects to those of the image 
processing method in the third application of the invention and has 
various arrangements as discussed above with regard to the image 
processing method. 

A fourth application of the invention is directed to an image 

20 processing method that executes image processing of image data 

having shooting information, which is obtained at a time of shooting and 
includes information on a selected shooting scene. The image 
processing method in the fourth application of the invention acquires 
image data; acquires a scene-dependent image processing condition 

25 suitable for the selected shooting scene from a memory device, which 
stores multiple scene-dependent image processing conditions as image 
processing conditions suitable for respective shooting scenes; and 
executes image quality adjustment of the image data with the acquired 
scene-dependent image processing condition. 

30 The image processing method in the fourth application of the 
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invention obtains the scene-dependent image processing condition 
suitable for the selected shooting scene and executes innage quality 
adjustment with the acquired scene-dependent image processing 
condition. This arrangement enables the image data to be subjected to 
5 image processing suitable for the shooting scene at the time of 
shooting. 

In one preferable arrangement of the fourth application of the 
invention, the image data is associated with scene-dependent image 
processing condition specification information, which is used to specify 

10 the scene-dependent image processing condition applied for image 
processing. The image processing method receives selection 
information that determines which of the selected shooting scene and 
the scene-dependent image processing scene condition is to be used to 
acquire the scene-dependent image processing condition, and acquires 

15 the scene-dependent image processing condition from the memory 
device, according to the received selection information. 

The procedure of this arrangement acquires the 
scene-dependent image processing condition, based on either the 
selected shooting scene or the scene-dependent image processing 

20 condition specification information, which is used to specify the 
scene-dependent image processing condition applied for image 
processing. This arrangement enables the image data to be subjected 
to image processing suitable for a desired shooting scene with desired 
information. 

25 In the fourth application of the invention, the memory device may 

store a first scene-dependent image processing condition corresponding 
to the shooting scene and a second scene-dependent image processing 
condition corresponding to the scene-dependent image processing 
condition specification information. The image processing method may 

30 select either of the first scene-dependent image processing condition 
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and the second scene-dependent image processing condition according 
to the received selection information, so as to acquire the 
scene-dependent image processing condition. This arrangement 
enables the image data to be subjected to more adequate image 
5 processing for a desired shooting scene. 

The fourth application of the invention is also actualized by an 
image processing apparatus that executes image processing of image 
data having shooting information, which is obtained at a time of shooting 
and includes information on a selected shooting scene. The image 

10 processing apparatus in the fourth application of the invention includes: 
an image data acquisition unit that acquires image data; a memory unit 
that stores multiple scene-dependent image processing conditions as 
image processing conditions suitable for respective shooting scenes; 
and an image quality adjustment unit that acquires a scene-dependent 

15 image processing condition suitable for the selected shooting scene 
from the memory unit and executes image quality adjustment of the 
image data with the acquired scene-dependent image processing 
condition. 

The image processing apparatus according to the fourth 
20 application of the invention has similar functions and effects to those of 
the image processing method in the fourth application of the invention 
and has various arrangements as discussed above with regard to the 
image processing method. 

The fourth application of the invention is further actualized by a 
25 computer program product storing an image processing program that 
causes a computer to execute image processing of image data having 
shooting information, which is obtained at a time of shooting and 
includes information on a selected shooting scene. In the computer 
program product according to the fourth application of the invention, the 
30 image processing program includes: a program code that acquires 
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image data; a program code that acquires a scene-dependent image 
processing condition suitable for the selected shooting scene from a 
memory device, which stores multiple scene-dependent image 
processing conditions as image processing conditions suitable for 
5 respective shooting scenes; and a program code that executes image 
quality adjustment of the image data with the acquired scene-dependent 
image processing condition. 

The computer program product according to the fourth 
application of the invention has similar functions and effects to those of 
10 the image processing method in the fourth application of the invention 
and has various arrangements as discussed above with regard to the 
image processing method. 

BRIEF DESCRIPTION OF THE DRAWINGS 
15 Fig. 1 shows an image processing system as one embodiment, to 

which an image processing apparatus of the Invention is applied; 

Fig. 2 is a block diagram schematically illustrating the structure 
of a digital still camera that is usable for generating image files (image 
data); 

20 Fig. 3 shows selection of a shooting mode in the digital still 

camera; 

Fig. 4 is a block diagram schematically illustrating the structure 
of a color printer functioning as an image processing apparatus in the 
embodiment; 

25 Fig. 5 shows the file structure of an Exif image file; 

Fig. 6 shows the detailed internal structure of shooting condition 
tags in the Exif file format used in the embodiment; 

Fig. 7 shows settings of multiple image quality-relating 
parameters, which are stored in an HDD 152 (or a ROM) of a personal 
30 computer PC and define options of an image processing mode GM 
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specified by image processing control information Gl; 

Fig. 8 is a flowchart showing an image processing routine 
executed by an image processing apparatus (personal computer PC) in 
the embodiment; 

5 Fig. 9 is a flowchart showing an image quality adjustment routine 

with the image processing control information Gl executed by the image 
processing apparatus (personal computer PC) in the embodiment; 

Fig. 10 is a flowchart showing an image quality adjustment 
routine with Exit information executed by the image processing 
10 apparatus (personal computer PC) in the embodiment; and 

Fig. 11 shows a table that maps the Exit information to the image 
processing mode GM. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

15 The image processing apparatus of the invention is discussed 

below as a preferred embodiment with reference to the accompanied 
drawings. 

A. Construction of Image Processing System 

The construction of an image processing system including an 

20 image processing apparatus in one embodiment is discussed below with 
reference to Figs. 1 through 4. Fig. 1 shows an image processing 
system as one embodiment, to which an image processing apparatus of 
the invention is applied. Fig. 2 is a block diagram schematically 
illustrating the structure of a digital still camera that is usable for 

25 generating image files (image data). Fig. 3 shows selection of a 
shooting mode in the digital still camera. Fig. 4 is a block diagram 
schematically illustrating the structure of a color printer functioning as 
an image processing apparatus in the embodiment. 

The image processing system includes a digital still camera 12 

30 functioning as an input device to generate an image file, a personal 
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computer PC functioning as an image processing apparatus to execute 
image processing based on the image file generated by the digital still 
camera 12 and to output print image data, and a color printer 20 
functioning as an output device to output resulting images according to 
5 the print image data. The color printer 20 may have the image 

processing functions of the personal computer PC. In this case, the 
color printer 20 works as a stand-alone to implement image processing 
and output of resulting images. The output device is not restricted to 
the printer 20 but may be a monitor 14 like a CRT display or an LCD 

10 display or a projector. In the description below, the color printer 20 
connecting with the personal computer PC is used as the output device. 

The personal computer PC is a general-purpose computer and 
includes a CPU 150 that executes an image processing program of the 
invention, a RAM 151 that temporarily stores the results of operations by 

15 the CPU 1 50 and image data, and a hard disk drive (HDD) 1 52 that 

stores the image processing program. The personal computer PC also 
has a card slot 153 that receives a memory card MC inserted therein 
and an input output terminal 154 that connects with a connector cable 
linked with the digital still camera 12. 

20 The digital still camera 12 focuses light information on a digital 

device (for example, a CCD or an electron multiplier tube) to acquire an 
image, and has an optical circuit 121 including the CCD or the like to 
collect the light information, an image acquisition circuit 122 that 
controls the optical circuit 121 to acquire a digital image, an image 

25 processing circuit 123 that processes the acquired digital image, and a 
control circuit 124 that has a memory and controls the respective 
circuits, as shown in Fig. 2. The digital still camera 12 stores the 
acquired images as digital data into a memory device, such as a 
memory card MC. The JPEG data format as an irreversible 

30 compression storage system and the TIFF data format as a reversible 
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compression storage system are typically applied for storage of image 
data in the digital still camera 12. Other storage formats like the RAW 
data format, the GIF data format, and the BMP data format are also 
applicable for storage of image data. 
5 As shown in Fig. 3, the digital still camera 12 also has a 

selection/set button 126 and a liquid crystal display 127, which Is used 
to preview each shot image and effectuate selection and setting through 
operations of the selection/set button 126. The selection/set button 
126 may be used to set a shooting mode, which specifies shooting 

10 conditions including a shutter speed, an exposure program, and an ISO 
speed rate, as well as values of multiple shooting parameters 
corresponding to each shooting scene, such as twilight scene, 
nightscape, or portrait. 

When the digital still camera 12 has the function of specifying a 

15 series of image processing to be executed by the image processing 
apparatus with image processing control information Gl, the 
selection/set button 126 may be used to set individual image processing 
control parameters, such as lightness, contrast, quantity of exposure 
correction (exposure correction value), and white balance, or to set an 

20 image processing mode (shooting mode), which specifies values of 
multiple image processing control parameters used in the image 
processing apparatus according to the shooting conditions. The 
selection/set button 126 may otherwise be used to set both the shooting 
mode and the image processing mode. 

25 The digital still camera 12 maps image processing control 

information Gl, which is used to specify image processing of image data 
executed by the image processing apparatus (the color printer 20 and 
the personal computer PC), or Exit information, which represents 
shooting information at the time of shooting image data, to the image 

30 data and stores the mapping in the form of an image file GF into the 
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memory card MC. When the user selects a shooting mode (shooting 
scene), for example, portrait, nightscape, or twilight scene, suitable for 
shooting conditions, the procedure maps the selected shooting mode as 
the Exif information to the image data or maps an image processing 
5 mode, which corresponds to the selected shooting mode and specifies 
values or levels of multiple image processing control parameters 
including contrast, saturation, and sharpness, to the Image data and 
stores the mapping into the memory card MC. The multiple image 
processing control parameters may include individually settable 

10 parameters like the quantity of exposure correction and the white 
balance. The settings of shooting parameters applied for each 
shooting mode and image processing parameters are related to the 
shooting mode and are stored on the memory in the control circuit 124 of 
the digital still camera 12. 

15 The image file GF generated by the digital still camera 12 is 

transmitted to the color printer 20 via a connector cable CV and the 
computer PC or directly via the connector cable CV. The image file GF 
is otherwise transmitted to the color printer 20 by inserting the memory 
card MC, in which the image file GF has been stored by the digital still 

20 camera 12, into a memory card slot of the computer PC or by directly 
connecting the memory card MC with the printer 20. In the structure of 
the embodiment, the personal computer PC executes image processing 
of the image data with the image processing control information Gl and 
outputs the processed image data to the color printer 20. 

25 The color printer 20 shown in Fig. 4 is capable of outputting color 

images and is, for example, an ink jet printer that ejects four color inks, 
cyan (C), magenta (M), yellow (Y), and black (K), on a printing medium 
to create a dot pattern and thereby form an image. Another example of 
the color printer 20 is an electrophotographic printer that transfers and 

30 fixes color toners on a printing medium to form an image. Other color 
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inks, light cyan (LC), light magenta (LM), and dark yellow (DY) may also 
be used, in addition to the above four color inks. 

As illustrated, the color printer 20 has a mechanism that drives 
print heads IH1 through IH4 mounted on a carriage 30 to eject inks and 
5 create dots, a mechanism that activates a carriage motor 31 to 

reciprocate the carriage 30 along a shaft of a platen 32, a mechanism 
that activates a sheet feed motor 33 to feed a cut sheet of printing paper 
40, and a control circuit 50. The mechanism of reciprocating the 
carriage 30 along the shaft of the platen 32 has a sliding shaft 34 that 

10 holds the carriage 30 arranged in parallel with the shaft of the platen 32 
in a slidable manner and a pulley 36 that supports an endless belt 35 
spanned between the carriage motor 31 and the pulley 36. 

The control circuit 50 adequately controls the operations of the 
sheet feed motor 33, the carriage motor 31 , and the print heads IH1 

15 through IH4 in response to a print command sent from the personal 
computer PC and outputs image data sent from the personal computer 
PC as an image on a printing medium. Ink cartridge INC1 and INC2 are 
attached to the carriage 30. The ink cartridge I NCI keeps black (K) ink, 
whereas the ink cartridge INC2 keeps the other inks, that is, the three 

20 color inks, cyan (C), magenta (M), and yellow (Y). Additional inks of 
light cyan (LC), light magenta (LM), and dark yellow (DY) may also be 
kept in the ink cartridge, as mentioned previously. 

B. Structure of Image file 

25 The image file GF of this embodiment may have, for example, a 

file structure in conformity with the Exif format (Exif file) that was 
specified as a standard of the image file format for digital still cameras 
by Japan Electronics and Information Technology Industries Association 
(JEITA), a file structure in conformity with the JFIF format (JFIF file) that 

30 was specified as a standard for making JPEG data files compatible by 
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three corporations, C-Cube Microsystems, Xing Technology, and Digital 
Origin (Radius), or a file structure in conformity with the TIFF format 
(TIFF file) that specifies parameters relating to image data in the form of 
tags. The Exif files are classified by the type of image data stored 
5 therein into JPEG-Exif files that store JPEG image data In an 

irreversible compressed form and TIFF-Exif files that store TIFF image 
data in a reversible compressed form. 

The general structure of an Exif image file as a JPEG data 
storage file used in this embodiment is discussed below with reference 

10 to Figs. 5 through 7. Fig. 5 shows the file structure of an Exif image file. 
Fig. 6 shows the detailed internal structure of shooting condition tags in 
the Exif file format used in the embodiment. Fig. 7 shows settings of 
multiple image quality-relating parameters, which are stored in the HDD 
152 (or the ROM) of the personal computer PC and define options of an 

15 image processing mode GM specified by the image processing control 
information Gl. The terminology 'file structure', 'data structure', and 
'storage area' used in this embodiment represents the image of a file or 
data in the storage state in a storage device. 

The image file GF includes JPEG image data GD and application 

20 marker segments APP to store attribute information of the JPEG image 
data GD. The application marker segments APP (IFD) use tags for 
identifying respective pieces of information, and each piece of 
information may be expressed by its corresponding tag name. The 
application marker segments APP shown in Fig. 5 include tags (area) for 

25 storing the image processing control information Gi, tags (area) for 
storing the Exif information, and thumbnail image data. 

Settings of image quality-relating parameters applied for image 
processing executed by the personal computer PC or the color printer 
20 are described in the image processing control information Gl. The 

30 image quality-relating parameters include, for example, YCbCr to RGB 
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color conversion matrix elements and gamma correction values, 
contrast, saturation, sharpness, lightness, and color balance of the 
digital still camera 12. The image processing control information Gl 
also includes image processing mode specification information, which is 
5 used to specify an image processing mode GM corresponding to a 

shooting mode selected at the time of shooting. The image processing 
mode GM is defined by multiple image quality-relating parameters, for 
example, contrast and saturation, as shown in Fig. 7. Each of the 
image quality-relating parameters takes different values corresponding 

10 to different image processing modes GM (shooting modes). A number 
is allocated to each image processing mode GM. The image 
processing control information Gl specifies a number to identify each 
image processing mode GM. 

The Exif information includes tags for storing user information 

15 and tags for storing shooting conditions. The user information tags 
include a Makernote tag arbitrarily usable by the Exif file user (for 
example, the manufacturer of the DSC). The image processing control 
information Gl may be described in this Makernote tag. Settings of 
various parameters relating to shooting conditions including an 

20 exposure program and a shutter speed are described in the shooting 
condition tags as shown in Fig. 6. 

C. Image Processing Executed by Personal Computer PC 

A series of image processing executed by the personal computer 

25 PC is discussed below with reference to Figs. 8 through 11. Fig. 8 is a 
flowchart showing an image processing routine executed by the image 
processing apparatus (the personal computer PC) in the embodiment. 
Fig. 9 is a flowchart showing an image quality adjustment routine with 
the image processing control information Gl executed by the image 

30 processing apparatus (the personal computer PC) in the embodiment. 
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Fig. 10 is a flowchart showing an image quality adjustment routine with 
the Exit information executed by the image processing apparatus (the 
personal computer PC) In the embodiment. Fig. 11 shows a table that 
maps the Exif information to the image processing mode GM. 
5 The CPU 150 of the personal computer PC activates an Image 

quality adjustment program, in response to Insertion of the memory card 
MC into the card slot 153 or in response to connection of the connector 
cable CV linked with the digital still camera 12 to the input output 
terminal 154. The CPU 150 first reads an image file GF from the 

10 memory card MC according to the user's instruction and temporarily 
stores the read-out image file GF into the RAM 151 (step SI 00). 

The CPU 150 determines whether the Image file GF includes the 
image processing control information Gl (step S1 10). When the Image 
processing control information Gl is found (detected) in the image file 

15 GF (step S1 10: Yes), the CPU 150 acquires the image processing 
control information Gl (step SI 20) and executes a series of image 
processing (image quality adjustment) with the acquired image 
processing control information Gl (step SI 30). 

The series of Image processing with the image processing 

20 control Information Gl is described with reference to Fig. 9. The CPU 
150 extends the image data GD included In the read-out Image file GF 
and sequentially carries out matrix algebra with a matrix S on the 
extended image data GD, gamma correction with gamma correction 
values specified by the acquired Image processing control Information 

25 Gl, and matrix algebra with a matrix N'^M including a matrix M, so as to 
Implement color conversion of YCbCr into wRGB (step S200). 

The image file GF processed according to this flowchart stores 
JPEG image data, which represent YCbCr data in a compressed form. 
RGB data are generally used for image processing executed by the 

30 personal computer PC and the printer. Extension (decoding) of the 
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JPEG data and the color conversion of YCbCr data into RGB data are 
accordingly required. The matrix S is typically used for conversion of 
YCbCr data into RGB data in the JFIF format as is known in the art, and 
is thus not specifically described here. For linearization of the relation 
5 to XYZ values in the course of color conversion, the gamma correction is 
carried out with the gamma correction values specified by the image 
processing control information Gl to attain linearization of the image 
data GD. 

The procedure of this embodiment carries out RGB to wRGB 

10 color conversion with the matrix N'^M including the matrix M, which 
takes into account the color reproduction characteristics of the color 
printer 20, in addition to the general YCbCr to RGB color conversion 
with the matrix S. The matrix M has elements specified by the image 
processing control information Gl, and is used to convert the color 

15 space from an RGB color space (target color space) that defines 

(specifies) RGB data after the matrix algebra with the matrix S into an 
XYZ color space that is a device-dependent color space. When the 
RGB data after the matrix algebra with the matrix S have RGB values 
out of the color range of an sRGB color space, a wRGB color space at 

20 least partly having a wider color range than the sRGB color space is 
specified as the color space defining the RGB data after matrix algebra 
with the matrix S. This arrangement effectively prevents loss of the 
RGB values and leads to a subsequent wider wRGB color space 
(working color space). The matrix N is used to convert the color space 

25 from an RGB color space allowed by the color printer 20, for example, a 
wRGB color space, into an XYZ color space. The matrix N"^M is a 
composite matrix to attain color conversion from RGB to XYZ to wRGB. 

The CPU 150 acquires the image processing mode GM specified 
by the image processing control information Gl (step S210) and 

30 executes image quality adjustment of the resulting RGB data obtained 
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by the color conversion with a set of parameters specified by the 
acquired image processing mode GM (step S220). According to a 
concrete procedure, the CPU 150 carries out image quality adjustment 
with the settings of the image quality-relating parameters defined by one 
5 of the options 1 through 11 of the image processing modes GM shown in 
Fig. 7, which corresponds to the number specified by the image 
processing control information Gl. The procedure of image quality 
adjustment is explained in detail. The CPU 150 analyzes the image 
data GD in units of pixel and obtains values of various characteristic 

10 parameters representing the characteristics of the image data GD, for 
example, image statistics like a minimum luminance, a maximum 
luminance, and a representative lightness. The CPU 150 specifies 
correction values to cancel or at least reduce differences between 
reference values, which are preset for the respective characteristic 

15 parameters and are stored in the HDD 152, and the image statistics 

obtained by the analysis, and corrects the RGB values of the image data 
GD. The correction of the image data GD, for example, corrects a tone 
curve, which defines a relation between input and output, with the 
specified correction values and substitutes the image data GD as an 

20 input into the corrected tone curve. 

The parameter values specified by the image processing mode 
GM are used to change the degree of cancellation or the degree of 
reduction (the amount of correction) of the difference between the 
reference value and the image statistic, while being directly reflected on 

25 the amount of correction (the correction value). 

For example, when a number '2' is set as the image processing 
mode GM, the degrees of correction to the reference values are set as 
slightly softer (slightly weaker) for contrast, slightly brighter (slightly 
stronger) for lightness, standard for color balance, slightly lower (slightly 

30 weaker) for saturation, and slightly weaker for sharpness. The flesh 
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color is set as the stored color, so that flesh color data (RGB values) 
stored in advance in the HDD 152 are used for the image processing. 
The noise reduction is set OFF. The image quality adjustment is 
carried out in the image processing mode corresponding to each 
5 shooting scene. When the selected shooting scene is twilight scene, 
for example, red color seepage is not removed. When the selected 
shooting scene is nightscape, in another example, the image data is not 
corrected to be brighter by lightness correction. Namely this 
arrangement ensures execution of image quality adjustment reflecting 

10 the intention of the photographer. 

The Image processing control information Gl may include 
individually settable, image quality-relating parameters, such as 
lightness and contrast, other than a set of image quality-relating 
parameters for specifying the image processing mode GM. Such 

15 individually settable parameters are not specifically described here. 
The CPU 150 carries out color conversion to convert the 
resulting image data (RGB data) after the image quality adjustment into 
CMYK data (step S230), and returns to the image processing routine 
shown in Fig. 8. This process converts the color system of the image 

20 data to the CMYK color system adopted by the color printer 20 for 
execution of printing. A concrete procedure refers to a lookup table, 
which maps the RGB color system to the CMYK color system and is 
stored in the HDD 152 (ROM). 

When the series of image processing discussed above is 

25 concluded and the program returns to the image processing routine 
shown in Fig. 8, the CPU 150 carries out a print output process of the 
resulting image data (step S140) and then exits from this processing 
routine. In the print output process, the CPU 150 successively 
executes a halftoning process and a resolution conversion process and 

30 transmits the processed data as raster data to the control circuit 50 of 
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the color printer 20. 

When the image processing control information Gl is not 
detected in the image file GF (step S110: No), the CPU 150 determines 
whether the Exif information is detected in the image file GF (step S150). 
5 When the Exif information is not retrieved in the image file GF (step 
SI 50: No), the CPU 150 carries out a series of standard image 
processing with preset image processing conditions, which do not 
depend upon the selected shooting mode (step SI 80), outputs the 
processed image data (step SI 40), and exits from this processing 

10 routine. The standard image processing may execute image quality 
adjustment with reference values. 

When the Exif information is retrieved in the image file GF (step 
SI 50; Yes), on the other hand, the CPU 150 acquires the Exif 
information (step SI 60) and carries out a series of image processing 

15 (image quality adjustment) with the acquired Exif information (step 
S170). 

The series of image processing with the Exif information is 
discussed below with reference to Fig. 10. The CPU 150 extends the 
image data GD included in the read-out image file GF and carries out 

20 matrix algebra with the matrix S on the extended image data GD, so as 
to attain YCbCr to RGB color conversion (step S300). The CPU 150 
subsequently determines whether a selected shooting mode, for 
example, portrait, twilight scene, or nightscape, is described in the Exif 
information (step S310). 

25 When the shooting mode is detected in the Exif information (step 

S310: Yes), the CPU 150 selects and acquires the image processing 
mode GM corresponding to the shooting mode described in the Exif 
information (step S320) and executes image quality adjustment in the 
acquired image processing mode GM (step S330). In general, the 

30 number of shooting modes described as the Exif information is less than 

27 



PF04J201 

the number of image processing modes GM. No problem accordingly 
arises in the mapping of the Exif information to the image processing 
mode GM. When the number of shooting modes described as the Exif 
information exceeds the number of image processing modes GM, the 
5 number of image processing modes GM is simply to be increased. The 
image quality adjustment in the image processing mode GM follows the 
procedure of image processing with the image processing control 
information Gl discussed above. 

When the shooting mode is not detected in the Exif information 

10 (step S310: No), on the other hand, the CPU 150 selects and acquires 
the image processing mode GM based on other shooting conditions 
described in the Exif information (step S340) and executes image 
quality adjustment in the acquired image processing mode GM (step 
S330). A table shown in Fig. 11 is, for example, applicable for the 

15 mapping of the shooting conditions to the image processing mode GM. 
The shooting conditions used in this embodiment are a combination of 
an exposure program for setting the priority to either of the shooting 
parameters, the exposure or the shutter speed, an aperture value (F 
number) representing the setting of light exposure to the CCD, a shutter 

20 speed representing the setting of an exposure time to the CCD, a 

subject distance range, an ISO speed rate representing the sensitizing 
quantity, and a flash operating state like prohibited emission or forcible 
emission. These shooting conditions are only illustrative and not 
restrictive in any sense. Other shooting conditions including white 

25 balance, gain control, contrast, saturation, and sharpness of shooting, a 
digital zoom magnification, an exposure time, a light source, and a 
subject area may adequately be added to the above combination or 
used in different combinations. 

The CPU 150 carries out color conversion to convert the 

30 resulting image data (RGB data) after the image quality adjustment into 
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CMYK data (step S350), and returns to the image processing routine 
shown in Fig. 8. This process converts the color system of the image 
data to the CMYK color system adopted by the color printer 20 for 
execution of printing. A concrete procedure refers to a lookup table, 
5 which maps the RGB color system to the CMYK color system and is 
stored in the HDD 152 (ROM). 

When the series of image processing discussed above is 
concluded and the program returns to the image processing routine 
shown in Fig. 8, the CPU 150 carries out the print output process of the 

10 resulting image data (step S140) and then exits from this processing 
routine. In the print output process, the CPU 150 successively 
executes a halftoning process and a resolution conversion process and 
transmits the processed data as raster data to the control circuit 50 of 
the color printer 20. 

15 As described above, when the image processing control 

information Gl includes the information for specifying the image 
processing mode GM, the personal computer PC functioning as the 
image processing apparatus of the embodiment executes image 
processing (image quality adjustment) in the image processing mode 

20 GM selected according to the mode-specifying information. This 
arrangement ensures execution of image quality adjustment 
corresponding to the shooting mode selected at the time of shooting, 
that is, image processing to give the photographer's desired output 
image. 

25 When the information for specifying the image processing mode 

GM is not included in the image processing control information Gl, the 
procedure executes image quality adjustment in the selected image 
processing mode GM corresponding to the shooting mode described as 
the Exif information. This arrangement ensures execution of image 

30 quality adjustment corresponding to the shooting mode selected at the 
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time of shooting, that is, image processing that reflects the intention of 
the photographer. 

When the shooting mode is not described as the Exit information, 
the procedure uses the Exit information other than the shooting mode to 
5 select the image processing mode GM corresponding to the shooting 
mode at the time of shooting and executes image quality adjustment in 
the selected image processing mode GM. As long as the Exif 
information is included in the image file GF, this arrangement ensures 
execution of image processing corresponding to the shooting scene at 

10 the time of shooting, that Is, the image quality adjustment reflecting the 
photographer's intention. 

The personal computer PC functioning as the image processing 
apparatus of the embodiment selectively executes an adequate series of 
Image processing among the three options discussed above according 

15 to the image file GF. This arrangement ensures execution of the most 
adequate image quality adjustment well reflecting the photographer's 
Intention and enables a greater number of Image files GF to be 
subjected to the desired image quality adjustment. 

The procedure of the above embodiment utilizes either the 

20 information for specifying the image processing mode GM or the 

shooting mode described as the Exif information to specify the image 
processing mode GM, based on whether the information for specifying 
the image processing mode GM is included in the image processing 
control information Gl. One possible modification may utilize either the 

25 information for specifying the image processing mode GM or the 

shooting mode described as the Exif Information to specify the image 
processing mode GM, In response to the user's selection. This 
modified arrangement ensures execution of Image processing that 
adequately reflects the user's intention. 

30 The procedure of the above embodiment adopts the image 
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processing mode GM corresponding to the image processing control 
information Gl. One possible modification provides an image 
processing mode GM* corresponding to the shooting mode, in addition to 
the image processing mode GM corresponding to the image processing 
5 control information Gl, and executes image processing. In response to 
the user's selection, either in the image processing mode GM 
corresponding to the Information for specifying the image processing 
mode GM or in the image processing mode GM' corresponding to the 
shooting mode described as the Exif information. This arrangement 

10 ensures execution of adequate Image processing that well reflects the 
user's intention. 

When the image processing control Information Gl does not 
include the information for specifying the Image processing mode GM, 
the procedure executes image quality adjustment In the image 

15 processing mode GM, which is selected corresponding to the shooting 
mode described as the Exif information. This arrangement ensures 
image quality adjustment corresponding to the selected shooting mode, 
that is, image processing that well reflects the photographer's intention. 
In the structure of the above embodiment, the personal computer 

20 PC functioning as the image processing apparatus executes the whole 
series of image processing and outputs the processed image data to the 
color printer 20. In one modified structure, the color printer 20 may 
execute, without the assistant of the personal computer PC, all or part of 
the image processing and create a dot pattern according to the 

25 processed image data GD on a printing medium. The computer may 
assist the execution. In such modification, the color printer 20 has the 
image processing functions discussed above with reference to Figs. 8 
through 11. The image file GF generated by the digital still camera 12 
is directly transmitted to the color printer 20 via the cable or via the 

30 memory card MC. The image processing program is automatically 
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activated in response to detection of insertion of the memory card MC or 
in response to detection of attachment of the cable, to automatically 
perform input of the image file GF, retrieval of the image processing 
control information Gl and the Exif information, conversion of the image 
5 data GD, and image quality adjustment. Another possible modification 
provides an auto image quality adjustment button on the operation panel 
of the color printer 20. The auto image quality adjustment process 
discussed in the above embodiment may be executed only in the case of 
selection of an auto image quality adjustment mode through the 

10 operation of the auto image quality adjustment button. 

In the structure of the above embodiment, the color printer 20 is 
used as the output device. The output device may be a display device, 
such as a CRT, an LCD, or a projector. In such cases, the display 
device functioning as the output device executes an image processing 

15 program (display driver) to implement the image processing described 
above with reference to Figs. 8 through 11. When the CRT or the like 
functions as a display device of the computer, the computer executes 
the image processing program. Here the eventually output image data 
has the RGB color space, instead of the CMYK color space. 

20 The resulting display on the display device, such as the CRT, 

reflects the image processing control information Gl, as the resulting 
print by the color printer 20 reflects the information obtained at the time 
of generating the image data. This arrangement ensures accurate 
display of the image data GD generated by the digital still camera 12. 

25 The embodiment regards the image file complying with the Exif 

file format as a concrete example of the image file GF. The image 
processing apparatus of the invention is, however, not restricted to 
processing of the image files of this format, but is also applicable to 
processing of the image files GF complying with the JFIF file format and 

30 those complying with the TIFF file format. The image file processible 
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by the image processing apparatus of the invention is required to 
include the image data GD and at least either of the image processing 
control information Gl and the Exif information related to the image data 
GD. 

5 In the embodiment discussed above, the personal computer PC 

and the color printer 20 are only illustrative and are not restricted to the 
structure discussed above. The personal computer PC and the color 
printer 20 are required to have at least the functions of retrieving the 
image processing control information Gl or the Exif information in the 

10 image file GF, which may store both of the image processing control 
information Gl and the Exif information, selecting the image processing 
mode GM based on the retrieved information, carrying out auto image 
quality adjustment in the selected image processing mode GM, and 
outputting (printing) the processed image. 

15 In the structure of the above embodiment, the image data GD 

and the image processing control information Gl are included in the 
identical image file GF. The image data GD and the image processing 
control information Gl may not be stored in an identical file. The 
requirement is that the image data GD is related to the image 

20 processing control information Gl. One possible modification 

generates mapping data to relate the image data GD to the image 
processing control information Gl, stores one or multiple image data GD 
and the image processing control information Gl in separate files, and 
refers to the image processing control information Gl related to the 

25 image data GD at the time of processing the image data GD. In this 
modified structure, the image data is inseparably integrated with the 
image processing control information Gl in the course of image 
processing with the image processing control information Gl. This 
gives the substantially equivalent functions to those attained by storage 

30 in the identical file. The technique is also applicable to video files 
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Stored in optical disk media, such as CD-ROMs, CD-Rs, DVD-ROMs, 
and DVD-RAMs. 

The image processing apparatus and the image processing 
method of the invention are described above with reference to some 
embodiments. These embodiments are to be considered in all aspects 
as illustrative and not restrictive. There may be many modifications, 
changes, and alterations without departing from the scope or spirit of 
the main characteristics of the present invention. All changes within 
the meaning and range of equivalency of the claims are therefore 
intended to be embraced therein. 
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